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FLUID LIMITS FOR NETWORKS WITH BANDWIDTH SHARING 
AND GENERAL DOCUMENT SIZE DISTRIBUTIONS 

By H. Christian Gromoll^ and Ruth J. Williams^ 
University of Virginia and University of California, San Diego 

We consider a stochastic model of Internet congestion control, 
introduced by Massoulie and Roberts [Telecommunication Systems 
15 (2000) 185-201], that represents the randomly varying number of 
flows in a network where bandwidth is shared among document trans- 
fers. In contrast to an earlier work by Kelly and Williams [Ann. Appl. 
Probab. 14 (2004) 1055-1083], the present paper allows interarrival 
times and document sizes to be generally distributed, rather than ex- 
ponentially distributed. Furthermore, we allow a fairly general class 
of bandwidth sharing policies that includes the weighted Q-fair poli- 
cies of Mo and Walrand [IEEE/ ACM Transactions on Networking 
8 (2000) 556-567], as well as certain other utility based scheduling 
policies. To describe the evolution of the system, measure valued 
processes are used to keep track of the residual document sizes of 
all flows through the network. We propose a fluid model (or formal 
functional law of large numbers approximation) associated with the 
stochastic flow level model. Under mild conditions, we show that the 
appropriately rescaled measure valued processes corresponding to a 
sequence of such models (with fixed network structure) are tight, 
and that any weak limit point of the sequence is almost surely a fluid 
model solution. For the special case of weighted a-fair policies, we 
also characterize the invariant states of the fluid model. 

1. Introduction. Massoulie and Roberts [18] have introduced and stud- 
ied a model of Internet congestion control that represents the randomly 
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varying number of flows in a network where bandwidth is shared dynami- 
cahy among flows. The flows correspond to continuous transfers of individ- 
ual elastic documents. This connection level model assumes a "separation 
of time scales" such that the time scale of the flow dynamics (of document 
arrivals and departures) is much longer than the time scale of the packet 
level dynamics on which rate control schemes such as TCP converge to equi- 
librium. 

Subsequent to the work of Massoulie and Roberts [18], assuming expo- 
nentially distributed document sizes, de Veciana, Lee and Konstantopoulos 
[5] and Bonald and Massoulie [1] studied the stability of the flow level model 
operating under various bandwidth sharing policies. A bandwidth sharing 
policy generalizes the notion of a processor sharing discipline from a single 
resource to a network with several shared resources. Lyapunov functions con- 
structed in [5] for weighted max-min fair and proportionally fair policies, and 
in [1] for weighted a-fair policies (a G (0, oo)) [19], imply positive recurrence 
of the Markov chain associated with the model when the average load on each 
resource is less than its capacity. Several authors [9, 13, 15, 16, 21, 22, 23] 
have considered variants of the Massoulie and Roberts model [18] and more 
general bandwidth sharing policies. In particular, Lin, Shroff and Srikant 
[15, 16, 21] have given sufficient conditions for stability where the assump- 
tion of time scale separation is relaxed. Ye [22], Ye, Ou and Yuan [23] and 
Hansen, Reynolds and Zachary [9] have given conditions for stability and 
instability with more general bandwidth sharing policies. Key and Mas- 
soulie [13] have considered a model with file transfers and streaming fiows, 
certain utility based policies and relaxed capacity constraints. However, all 
of these works maintain a critical exponential distributional assumption on 
document sizes or holding times to enable the use of a relatively simple 
Markovian model. A major aim of our work is to relax this exponential 
assumption. 

Here, we consider the model of Massoulie and Roberts, with generally 
distributed document sizes and interarrival times, operating under a fairly 
general bandwidth sharing policy. Important examples of this policy include 
the weighted a-fair policies introduced by Mo and Walrand [19], and more 
generally certain utility based policies (see, e.g., [3, 13, 22, 23]) in the con- 
text of fiow level models. We are interested in the stability and heavy traffic 
behavior of this flow level model. (Despite the claim in [1], the proof of suffi- 
cient conditions for stability under weighted a-fair policies given there does 
not apply when document sizes are other than exponentially distributed. 
The reason for this is that the method of Dai [4] quoted there implicitly as- 
sumes (through the form of the model equations) that the service discipline 
is a head-of-the-line discipline. Consequently, the method does not apply in 
general to processor sharing type disciplines, such as the bandwidth sharing 
policies considered here. In the case of exponentially distributed document 
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sizes, one can equate the distribution of the queue length process for a band- 
width sharing model with the queue length process of a stochastic processing 
network (cf. [10]) operating under a head-of-the-line policy. Even then, to 
conclude the stability result using an analogue of Dai's result, one has to 
generalize the results of [4] to stochastic processing networks from multi- 
class queueing networks. However, in the case of exponential interarrival 
times and document sizes, the Lyapunov function given in [1] can be used 
directly on the original Markov chain stochastic model to establish stability 
under the nominal condition that the average load placed on each resource 
is less than its capacity.) 

There are a few results on sufficient conditions for stability of the flow 
level model with general document size distributions. With Poisson arrivals 
and document sizes having a phase-type distribution, for a weighted a-fair 
policy with a = 1, Lakshmikantha, Beck and Srikant [14] have established 
stability of some two resource linear networks and a 2 x 2 grid network 
when the average load on each resource is less than its capacity. For gen- 
erally distributed interarrival and document sizes, Bramson [2] has shown 
sufficiency of such a condition for stability under a max-min fair policy (cor- 
responding to an Q-fair policy as a ^ oo). Under proportional fair sharing, 
Massoulie [17] has recently established stability of a fluid model for the 
flow level model with exponential interarrival and document sizes, and ad- 
ditional routing. From this, he infers stability of the stochastic flow level 
model when documents have phase-type distributions. In general, however, 
it remains an open question whether, with renewal arrivals and arbitrarily 
(rather than exponentially) distributed document sizes, the flow level model 
is stable under a weighted a-fair (or more general) bandwidth sharing policy 
when the nominal load placed on each resource is less than its capacity. In 
contemporaneous work, Chiang, Shah and Tang [3] have developed a fluid 
approximation for the flow level model when the arrival rate and capac- 
ity are allowed to grow proportionally but the bandwidth per flow stays 
uniformly bounded. Using their fluid model, they derive some conclusions 
concerning rate stability for general (bounded) document size distributions 
when a € (0, oo) is sufficiently small. 

This paper is a first step in our study of the flow level model with gen- 
eral interarrival and document size distributions, and a general bandwidth 
sharing policy. Here, we deflne measure valued processes that keep track 
of the residual sizes of all documents in the system at any given time. We 
propose a fluid model (or formal functional law of large numbers approxima- 
tion) associated with the stochastic flow level model. Under mild conditions, 
we show that the measure valued processes corresponding to a fluid scaled 
sequence of such models (with fixed network structure) are tight and that 
any weak limit point of the sequence is almost surely a fiuid model solution. 
For weighted a-fair policies, we also characterize the invariant states for the 
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fluid model. In future work, we plan to study the asymptotic behavior of 
fluid model solutions and to use that to study the stability and heavy traffic 
behavior of the associated flow level models. A summary of the results of this 
paper as they pertain to weighted a-fair policies appears in [8], along with 
two examples showing stability of the fluid model under a natural condition 
for linear networks and simple tree networks. 

The paper is organized as follows. In Section 2, we define the network 
structure, the bandwidth sharing policy, the stochastic flow level model and 
we introduce the measure valued processes used to describe the evolution of 
the system. The notion of a fluid model solution is deflned in Section 3. In 
Section 4, we introduce a sequence of flow level models and state our main 
result concerning the tightness of this sequence and that weak limit points 
are fluid model solutions (see Theorem 4.1). The proof of the main result is 
given in Section 5. In Section 6, we characterize the invariant states of the 
fluid model for weighted a-fair policies. 

1.1. Notation. Let N= {1,2,...}, let M= (-cx),oo), and let M'^ denote 
d-dimensional Euclidean space. For rE,y € M, x V y is the maximum of x 
and y, X Ay is the minimum of x and y, x"*" is the positive part and [x\ 
is the integer part of x. For x,y £ W^, let ||x|| = max^^j^ |xj|, and interpret 
vector inequalities componentwise: x <y means Xj < yi for all i = 1, . . . ,d. 
The positive d-dimensional orthant is denoted = {x G M*^ : x > 0}. To 
ease notation throughout the paper, all vectors are considered to be column 
vectors when used in mathematical expressions, but will be written out 
as row vectors within paragraphs. Also, deflne c/0 to be zero for any real 
constant c, and define a sum over an empty set of indices or of the form 
J2k=j with j > I to be zero. 

For two functions / and g with the same domain, f = g means /(x) = g{x) 
for all X in the domain. For a bounded function y^:IR_j_ — > M, let ||/||oo — 
sup^jgjR^ |/(x)|. Let Cb(]R+) be the set of continuous bounded functions 
/:M_i_ — > M, let C"^(R_|_) be the set of once continuously differentiable func- 
tions / :M+ ^ M, and let C^(M+) be the set of functions / in C^(]R+) that 
together with the first derivative /', are bounded on M+. If w G C^(R+) IS a 
function of time, its derivative will be denoted by w. For a Polish (complete 
separable metric) space S, let D([0,oo),5) be the space of right continuous 
functions from [0, oo) into iS that have left limits in S. Endow this space 
with the Skorohod Ji-topology. For a finite nonnegative Borel measure on 
R+ and a ^-integrable function / : M+ M, define 



If = (Ci) • • • ) ?d) is a vector of such measures, then (/, ^ is the vector 
((/i '^i)) • • • 1 (/) Cd))- All functions / : M+ — > M are extended to be identically 
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zero on (— oo,0) so that /(• — x) is well defined on IR+ for all x > 0. Let 
X '■ — > M+ denote the identity function xi^) = ^ foi' ^ G M+. 

Let M be the set of finite nonnegative Borel measures on M+, endowed 
with the weak topology: ^ in M if and only if (f,^^) — > (/, for all 

/ € Cb(]R4.). This topology is induced by the following generalization of the 
Prohorov metric: for ^, ^ S M define 

d[e, C] = mf{e > : ^{B) < C{B^) + e and 

(LI) 

C{B) < ^(S^) + e for ah nonempty closed B C M+}, 

where B^ = {x IR+ :infj;gB 1^^ — y| < £}• It will be convenient to extend 
the notion of uniform integrability for random variables (and their associ- 
ated distributions) to elements of M. Call a sequence {^^} C M uniformly 
integrable, if {x,^'') < og for all k and 

lim sup(xl[x,oo),C'') =0. 

It is easy to show that if C M is uniformly integrable and ^, 
then < and {x,^'') ^ {x,0- 

For I G N, let 

= {(6, ■ ■ ■ ,ei) G M for ah i < 1} 
and for ^, C € M^, define 

(L2) di[e,C]=maxdKi,Ci]. 

•i<i 

Equipped with the metric di[-,-], the space is Polish. Convergence of a 
sequence {^'^j to ^ in is also denoted ^'^ ^. The zero measure in M 
is denoted by 0. 

The notation X means X and Y are equal in distribution, and X"" 
X means the sequence {^"} converges in distribution to X . All continuous 
time stochastic processes used in this work are assumed to have sample paths 
that are right continuous with left limits. 

2. Flow level model. This section defines the network structure, the 
bandwidth sharing policy and the stochastic flow level model. 

2.1. Network structure. Consider a network with finitely many resources 
labelled by j = 1, . . . , J, and a finite set of routes labeled by i = 1, . . . , I. A 
route i is a nonempty subset of {1, . . . , J}, interpreted as the set of resources 
used by the route. Let A be the J x I incidence matrix satisfying Aji = 1 if 
resource j is used by route i, and Aji = otherwise. Since each route is a 
nonempty subset of {1, . . . , J}, no column of A is identically zero. 
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A flow on route i is the continuous transfer of a document through the 
resources used by the route. Assume that while being transferred, a flow 
takes simultaneous possession of all resources on its route. The processing 
rate allocated to a flow is the rate at which the associated document is being 
transferred. There may be multiple flows on a route, and the bandwidth Aj 
allocated to route i is the sum of the processing rates allocated to flows 
on route i. The bandwidth allocated through resource j is the sum of the 
bandwidths allocated to routes using resource j. Assume that each resource 
j < J has finite capacity Cj > 0, interpreted as the maximum bandwidth 
that can be allocated through it. Let C = (Ci,...,Cj) be the vector of 
capacities in M."^. Then any vector A = (Ai, . . . , Aj) of bandwidth allocations 
must satisfy 

AA<C. 

2.2. Bandwidth sharing policy. We consider the network operating under 
a policy that dynamically allocates bandwidth to routes as a function of the 
number of flows on all routes. The resulting allocation to each route is shared 
equally among individual flows on that route. 

Let Zi{t) denote the number of flows on route i < I at time t, and let 
Z{t) = {Zi(t), . . . ,Zi{t)) be the corresponding vector in R^. The bandwidth 
allocated to route i at time i is a function of the vector Z{t) and is denoted 
by Ai{Z{t)). The corresponding vector of bandwidth allocations at time t 
is A{Z{t)) = {Ai{Z{t)),...,Ai{Z{t))). Although the coordinates of Z{-) are 
nonnegative and integer valued, we assume that the function A is defined 
on the entire orthant to accommodate fluid analogues of Z{-) later. 

Definition 2.1. A bandwidth sharing policy for the network {A,C) is 
a function A : M'j, such that for each z G : 

(i) Ai{z) > for each i such that Zi > 0, 

(ii) Ai{z) = for each i such that Zi = 0, 

(iii) AA{z)<C, 

(iv) A{rz) = A{z) for each r > 0, and such that for each i < I, 

(v) Aj(-) is continuous on {z € M'j. : Zi > 0}. 

Properties (i) and (ii) imply that routes with active flows may not idle, 
and that no bandwidth is allocated to routes with no flows. Property (iii) is 
the basic feasibility constraint, and property (iv) requires that bandwidth 
allocations are invariant under scaling. Note that by property (iii), since 
each route uses at least one resource, we have 

(2.1) sup |lA(z)||<||C||. 
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We assume further that the bandwidth Ai{Z{t)) allocated to route i at 
time t is shared equally by all flows on the route. That is, if there are 
Zi{t) > flows on route i at time t, then each flow is allocated a processing 
rate of Ai{Z{t))/Zi{t) at time t. 

The following property of A(-) will be used later in this paper. 

Lemma 2.2. Let A(-) be a bandwidth sharing policy for the network 
{A, C). For each e, M S (0, oo), there exists c> such that for each i <1, 

K{z)>c on {z ^^\:Zi>e,\\z\\<M}. 

Proof. For each i < I, the function Aj(-) is continuous and strictly 
positive on {z G M]^ : > 0} by Definition 2.1. So A(-) is bounded away from 
zero on the compact subset {z G : -Zj > < M}. □ 

An important class of bandwidth sharing policies satisfying Definition 2.1 
is described below. 



Example. The following family of policies was introduced by Mo and 
Walrand [19]. Fix a parameter a € (0,00) and a vector of strictly posi- 
tive weights K = . . . , aci). For z € M^, let Tq{z) = {i < I : = 0} and 
Z+{z) = < I : > 0}. Let 0(2) = {A G : Aj = for all i G 1q{z)}. Define 
a function Gz : [—00, 00) by 



(2.2) G,(A) 



K,zf^, aG(0,oo)\{l}, 

Y KjZilogAi, a = l, 

iex+(z) 



where the value of ^^(A) is taken to be -co if a G [l,oo) and Aj = for 
some i G Xj^{z), and Gz{\) = if = 0. For each z G define K{z) 

as the unique vector A G that solves the optimization problem: 

(2.3) maximize ^^(A), 

(2.4) subject to ^A < C, 

(2.5) over Q{z). 

The resulting allocation is called a weighted a- fair allocation, and the 
function A:]R^ — > M]^ is called a weighted a- fair bandwidth sharing policy. 
Note that by (2.4) and (2.5), A satisfies properties (ii) and (iii) of Definition 
2.1. Properties (i), (iv), and (v) hold for A by the proofs of Lemmas A.l~ 
A. 3 of [12]. (Although it is assumed at the beginning of [12] that A has full 
row rank, scrutiny of the proofs of Lemmas A. 1-A. 3 in [12] reveals that this 
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assumption is not used in verifying these properties.) When Kj = 1 for all 
i < I, the case a = 1 and the limiting cases a ^ and a ^ oo correspond, 
respectively, to a bandwidth allocation that is proportionally fair, achieves 
maximum throughput, or is max-min fair [1, 19]. 

Some authors (see, e.g., Ye [22], Ye, Ou and Yuan [23], Key and Massoulie 
[13] and Chiang, Shah and Tang [3]) have proposed more general objective 
functions than Gz{-) for determining bandwidth allocations in the context 
of flow level models. Indeed, the optimization problem (2.3)-(2.5) can be 
replaced by an equivalent one for the per flow bandwidth allocations Xi = 
Xi/zi for i where Gz{X) given by (2.2) is replaced by 



When a more general strictly concave utility function U is used, properties 
(ii) and (iii) are immediate from the form of the optimization problem, prop- 
erties (i) and (v) will hold under suitable regularity conditions on U, and 
(as pointed out by Chiang, Shah and Tang [3]), the critical scaling property 
(iv) will be satisfied if U has the scaling property that U{rx) = g{r)U{x) for 
all r > 0, X > 0, and some function g : (0, oo) (0, oo). As Chiang, Shah and 
Tang [3] also indicate, by seeking a scaling limit involving large capacities, 
one can relax this last assumption. However, this involves allowing the net- 
work capacity C to grow with the scaling limit and is a different limiting 
regime than the one considered here; the present analysis is oriented toward 
a system with fixed network parameters A, C. 

2.3. Stochastic model. Henceforth, we fix a network structure {A, C) and 
a bandwidth sharing policy A. Our stochastic model of document fiows con- 
sists of the following: a collection of stochastic primitives Ei,...,Ei and 
{^ifclfcLi, • • • , {fifc}^;^ describing the arrivals of document fiows (including 
their sizes) to the network, a random initial condition 2(0) € specifying 
the state of the system at time zero and a collection of performance pro- 
cesses describing the time evolution of the system state. The performance 
processes are defined in terms of the primitives and initial condition through 
a set of descriptive equations. The random objects involved are defined on 
a common probability space (r2,^,P), with expectation operator E. 

The stochastic primitives consist of an exogenous arrival process Ei and a 
sequence of document sizes {vik}'k'=i foi^ each route z < I. The arrival process 
Ei is a counting process, that is, a nondecreasing, nonnegative integer valued 



^ KiZiU{Xi) 



and the utility function U is given by 





a= 1. 



FLUID LIMITS FOR BANDWIDTH SHARING 



9 



process starting from zero. For t>0, Ei{t) represents the number of flows 
that have arrived to route i during the time interval (0,i]. The /cth such 
arrival is called flow k on route i and arrives at time Uit = inf{i '>Q:Ei{t) > 
k} (note that simultaneous arrivals are allowed). Flows already on route i 
at time zero are called initial flows. 

For each i <I and A; > 1, the random variable Vik represents the initial 
size of the document associated with flow k on route i. This is the cumu- 
lative amount of processing that must be allocated to the flow to complete 
its transfer through the network. Assume that for each i < I, the random 
variables {wjfcjfcLi are strictly positive and form a sequence of independent 
and identically distributed random variables with common distribution ??j 
on ]R_).. Assume that the mean {x,'&i) € (0, oo) and let /ij = {xT'&i)~^- We 
make no further assumptions about the relationship between /Xj and Ei. 
The fluid approximation result stated in Section 4.3 below is valid for both 
underloaded and overloaded systems. 

It will be convenient to combine the collection of stochastic primitives into 
a single, measure valued load process. For each x € M_|_, let 6x €M. denote 
the Dirac point measure at x. 

Definition 2.3. For i <I, deflne the load process for route i by 
(2.6) £,(t)=^5,^„ t>0. 

k=l 

For t > s > 0, define the increment Ci{s,t) = Ci{t) — Ci{s). 

The process £. = (£i, . . . , £i) is a random element of the Skorohod space 
D([0,oo),M^). Note that C{s,t) G for aU t > s > 0. 

The initial condition specifies Z{0) = (Zi(0), . . . , Zi(0)), the number of 
initial fiows on each route at time zero, as well as the initial sizes of the 
documents associated to these flows. Assume that the components of Z{0) 
are nonnegative, integer valued random variables. The initial document sizes 
of the initial flows on route i <I are the first Zi{0) elements of a sequence 
{vii}'iZi of strictly positive random variables. A convenient way to express 
the initial condition is to define an initial random vector of measures Z{0) G 
with components 

1=1 

Henceforth, 2(0) will be used as the initial condition for the network. 

The performance processes consist of a measure valued process Z, taking 
values in D([0, oo), M^), and a collection of auxiliary processes {Z,T, U,W). 
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The process Z = {Zi, . . . ,Zi) takes values in D([0, oo),M^). For i < I and 
t > 0, Zi{t) is the number of (active) flows on route i at time t. Recall 
that at time t, the bandwidth allocated to route i is Aj(Z(i)), and this 
bandwidth is shared equally by all Zi{t) flows on route i; each such flow 
receives a processing rate of Aj(Z(f))/Zj(t), which equals zero by convention 
if Zi{t) = 0. Thus, a flow that is active on route i during a time interval 
[s,t] C [0,oo) receives cumulative service during [s,t] equal to 

(2.7) S.is,t)= r^^l^du. 



Zi{u) 

Consider flow k on route i. This flow arrives at time Uik and has initial 
document size fjfc. At time t > Uik, the cumulative service received by this 
flow during equals Si{Uik,t) /\Vik- The amount of service still required 

therefore equals {vik — Si{Uik,t))~^ . (Once this latter quantity becomes zero, 
the flow becomes inactive, i.e., it departs from the system.) A similar de- 
scription applies for the initial flows on route i. For t >0, k < Ei{t), and 
I < Zi{0), define the residual document size at time t of flow k on route i 
and initial flow / on route i, by 

(2.8) v,k{t) = {vik-Si{U,k,t))^ and iu{t) = {vu - S,{0,t))+ , 
respectively. 

The measure valued process Z = {Zi, . . . , Zi) is called the state descriptor; 
it tracks the residual document sizes of flows on all routes at any given time. 
Let 5^ G M denote the Dirac measure at a; if x € (0, oo), with 6q = 0. For 
t > and i <1, define the finite Borel measure 

(2-9) ^^w=ECw + E<.w 

1=1 k=l 

Note that at t = 0, this definition coincides with the definition of the initial 
condition Z{0). Note also that by definition of the residual document sizes, 
the measure Zi{t) has a unit of mass only for flows on route i that have not 
yet completed transfer. Thus, for all t > and i < I, 

(2.10) Zi{t) = {l,Zi{t)). 
For t > and i < I, define 

(2.11) Ti{t)= [\i{Z{s))ds. 

Jo 

The process T takes values in D([0, (X)),M^) and tracks the cumulative band- 
width allocated to each route. For t> 0, define 



(2.12) 



U{t) = Ct- AT{t). 
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The process U takes values in D([0, oo),M:]^) and tracks the cumulative un- 
used bandwidth capacity of each resource. Since AA{z) < C for all z € M^, 
the process U is nondecreasing. For t>0, define 

(2.13) Wit) = {x,Zit)). 

Recall that x(^) = ^ that integration against the vector of measures 
2{t) is interpreted componentwise. The process W takes values in the path 
space D([0,c3o),M^). By (2.9), Wi{t) is the sum of all residual document 
sizes on route i at time t. Thus, Wi{t) represents the immediate amount of 
work still to be transferred on route i at time t. It can be shown that 

(2.14) W^{t)=W^{0) + {x,C^{t))-T,{t), i<I,t>0. 

This equation describes the workload on route i at time t in terms of the 
cumulative amount of work that arrives to and is processed on the route 
during [0,t]. 

3. Fluid model. In this section, we define a fluid analogue of the stochas- 
tic model introduced in Section 2.3. The main goal of the paper is to es- 
tablish, under mild assumptions, that a sequence of fluid scaled stochastic 
state descriptors is tight and that weak limit points are fluid model solu- 
tions (see Theorem 4.1 below). Fix a vector of strictly positive constants 
u = (ui, . . . and a vector of probability measures = (i?i, . . . , i9i) in M^, 
satisfying (x, < oo and (Ijoj, i^i) = for all i <I. The constant i^i, i <I, 
will be the fluid analogue of mean arrival rate to route i in the stochastic 
model (when that exists). Let /ij = (X)^i)~^ pi = Ui/fii for each i < I. 
We do not impose criticality assumptions on the constants pi; they may 
take any value in (0, cxd). The fluid model consists of a deterministic mea- 
sure valued function of time, called the fluid model solution, and a collection 
of auxiliary functions of time defined below. 

Definition 3.1. Given a continuous function ( : [0, oo) — > M^, define the 
auxiliary functions {z,t,u,w) of (, with respect to the data (^, C, A,i/, i?), 
by 

z{t) = {i,m, 

Ti(t)=^ (Ai(z(s))l(o,oo)(^i(s)) +Pil{0}(^i(s)))'^'S, i<I, 

u{t) = Ct-AT(t), 
w{t) = {x,({t)) 
for all t > 0. 
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Here z{t) and r(i) take values in and u{t) will take values in MlJ.. On 
the other hand, w{t) takes values in [0,oo]^, as ({t) need not have a finite 
first moment [see (ii) below]. 

A fluid model solution is now defined via projections against test functions 
in the class 

C = {/gC,HM+):/(0)=/'(0)=0}. 

Definition 3.2. A fluid model solution for the data C, A, i/, i?) is 
a continuous function : [0, oo) — > that, together with its auxiliary func- 
tions {z,T,u), satisfies: 

(i) ||(l{o},C(i))ll=Ofor alH>0, 

(ii) Uj is nondecreasing for all j < J, 

(iii) for each f i <I, and t>0, 

{f,m) = {f,m) - [\f',Qis))^^^^^ds 



Ziis) 
(3.1) 

+ Mf^^i) l(0,oo)(^i('S))ds. 

Recall that in (3.1), the integrand in the first integral term is defined to 
be zero when its denominator is zero. 

In Definition 3.2, it is possible to extend property (iii) to the class of func- 
tions {/ G C^(M+) :/(0) = 0}, yielding an equivalent definition. The more 
restrictive class C is used here to facilitate parts of the proof of Theorem 
4.1 below. In particular, since /(O) = /'(O) = on C, a function in C can 
be extended to a function in C^(IR) by defining it to be identically zero on 
(-00,0). 

When the initial fluid workload is finite, we have the following result. 

Lemma 3.3. Suppose Q is a fluid model solution with finite initial work- 
load, that is, Wi{0) = (X)Ci(O)) < for all i <I. Then the fluid workload 
function w associated with C, satisfies the following for each i< \ and t > 0.' 

Wi{t) = Wi{{)) + [ {pi-Ai{z{s)))l/Qr^){zi{s))ds 

(3.2) 

= Wi{0) + Pit-Ti{t). 

In particular, the fluid workload Wi{t) is finite for all t>0 and i <I. 

Proof. To obtain the first equality in (3.2), approximate x by a se- 
quence of functions {/n} C C such that < /„ t X and < t l(o,oo) 
n — > oo, and then use monotone convergence in (3.1), noting property (i) of 
Definition 3.2. The second equality follows immediately from the definition 

of Ti. □ 
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Remark. In fact, (3.2) holds also if (%, Ci(0)) = oo, but then {x, Ci{t)) = 
oo for all t>0. 

4. Sequence of systems and fluid limit theorem. Let TZhe a sequence of 
positive real numbers increasing to infinity. Consider an 7^-indexed sequence 
of stochastic models, each defined as in Section 2.3 for the same underlying 
network structure {A, C) and bandwidth sharing policy A. For each r £TZ, 
there are arrival processes El,...,E^ with arrival times {U[i^}'^-^^, i < I; 
there are document sizes {v^/jj^li, • • • , {fi^lfc^i, with parameters i?^ and 
H"^; there is the corresponding measure valued load process C'; there is an 
initial condition Z^{0); there is a state descriptor Z'^ with auxiliary processes 
{Z'^ ,T'^ jU"^ ,W^) and cumulative service process 5^(-,-). The stochastic el- 
ements of each model are defined on a probability space (O*^ , P*") with 
expectation operator E^. 

4.1. Scaling. A fluid scaling (or law of large numbers scaling) is applied 
to each model in the 7^-indexed sequence. For each r G 7^ and t > s > 0, let 



E^it) = 






= S'''{rs, rt), 


C\t) = 


-r-(rt), 

r 


C{s,t)-- 


= -Cirs^ rt) 
r 


2' it) = 


Iz^irt), 




r 


T^(t) = 


r 




r 


W'^it) = 


-W^"(rt). 







With these definitions, (2.10)-(2.14), and the scaling property of Definition 
2.1(iv), we have that for r ^IZ and t > 0, 



(4.2) Z^{t) = {ia''{t)), 

(4.3) f[{t)= t Ai{Z'{s))ds, i<I, 

Jo 

(4.4) U'^{t)=Ct-Af'^{t), 

(4.5) W^it) = {x,Z''it)), 

(4.6) W'it) = W'\0) + {x,Cit))-f'{t). 



Also, (2.7) and Definition 2.1(iv) imply that for r G 7^ and [s,t] C [0, oo), 

(4.7) S:is,t)= f^^^^^^dn, ^<I. 

Js Zl [u) 
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4.2. Asymptotic assumptions. In this section, we impose asymptotic as- 
sumptions on the 7^-indexed sequence of models. This is the setting in which 
our fluid limit result, Theorem 4.1 below, is proved. 

Let v = {vi, . . . ^vi) he a vector of strictly positive constants and let i^(t) = 
vt for all t > 0. Let = . . . ^-di) be a vector of probability measures in 
satisfying 

(4.8) ||(l|o},^?)||=0, 

(4.9) ||(x,T?)||<oo. 

For i < I, let /ij = (x, and pi = Vij [li- Define p(t) = pt for all t > 0. For 
the sequence of arrival processes, assume that as r ^ cx), 

(4.10) E\.)^v{-). 

Conditions under which the functional law of large numbers result (4.10) 
holds are well known. For the sequence of document size distributions, as- 
sume that 

(4.11) r^i? asr^oo, 

(4.12) : r € 7?.} is uniformly integrable for each i < I. 
Note that (4.11) and (4.12) imply that 

(4.13) p^ ^ n as r ^ oo. 

For the sequence of fluid scaled initial conditions {Z^'{0) : r G TZ}, assume 
that as r ^ oo, 

(4.14) {Z^\0),{x,Z''m)^{2',{x,Z')), 

where is a random vector of measures (taking values in M^) satisfying 

(4.15) \\{x,Z^)\\<^ a.s., 

(4.16) Jim Pf sup |K1[.,.+5],20)|| < e) = 1 for ah e > 0. 



Assumption (4.15) means that the limiting initial workload on each route 
is finite almost surely; (4.16) is equivalent to the assumption that almost 
surely, Zf has no atoms for all i < I (see [7], Lemma A.l). 

4.3. Fluid limit theorem. The assumptions made so far are now summa- 
rized for ease of reference. 

There is a fixed network structure {A, C) and a bandwidth sharing 

policy A. There is a sequence of stochastic models, each defined as in 
(A) Section 2.3; there exist a vector of strictly positive constants v, a vector 

of probability measures G M^, and a random vector of measures Z^ 

taking values in such that (4.8) -(4. 16) hold. 

The following is the main result of the paper. 
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Theorem 4.1. Assume (A). The sequence Z^T*", C/^ VF'')} is C- 
tight, and each weak limit point (Z, Z,T,U,W) is such that almost surely, 
Z is a fluid model solution with auxiliary functions {Z, T, U, W) for the data 
(A, C, A,z/, where W{t) is finite for all t>0. 

5. Proof of Theorem 4.1. The proof has several stages. Section 5.1 con- 
tains a functional law of large numbers result for the measure valued load 
processes {C^}- This result follows from the assumptions imposed on the 
stochastic primitives. Section 5.2 derives two dynamic equations satisfied by 
the fluid scaled state descriptors {Z'^}, as well as several related bounds. Sec- 
tion 5.3 establishes a compact containment property, and Sections 5.4 and 
5.5 establish control of oscillations for the state descriptors. These proper- 
ties are combined in Section 5.6 to prove the tightness claim of Theorem 4.1, 
and properties of weak limit points are derived in Section 5.7. We assume 
(A) throughout this entire section. 

The general strategy outlined above is similar to that in [7]. However, the 
model studied here presents the additional complication of multiple routes 
that interact with each other via the bandwidth sharing policy A. In par- 
ticular, the numerator in the first integral term of (3.1) is a function of the 
current state of the whole system, as opposed to a constant as is the case 
in the analogous equation in [7]. This requires additional care to carry out 
the analysis. A key difference in the present proof is in verifying (at various 
stages along the way), that the assumptions imposed by Definition 2.1 on 
the more general function A are sufficient to allow the above strategy to 
go through. Furthermore, [7] focused only on a heavily loaded single server 
queue and its critical fluid limit. Here, we have a network of resources and 
there is no a priori assumption on the system load, that is, the traffic inten- 
sity parameters pi are unrestricted in (0, oo). This results in a more subtle 
fluid model and limit proof (see Section 5.7) related to the treatment of 
times when fluid queue lengths become zero. 

5.1. Limit of the primitive load processes. Recall that u{t) = vt, and 
p{t) = pt for ah t > 0. 

Theorem 5.1. Asr^oo, 

(5.1) {c\-),{x,c-{-)))^{i^mp{-)). 

The proof of this theorem is a straightforward application of a functional 
law of large numbers. For completeness, a proof is given in the Appendix. 
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5.2. Dynamic equations. Fix r ^TZ. For each route z < I, a dynamic 
equation satisfied by the component (•) of the fluid scaled state descrip- 
tor is the starting point for much of our subsequent analysis. The equation 
results, after some simplification, from substituting the definition of the 
residual document sizes (2.8) into (2.9). Almost surely, for all Borel measur- 
able / : M+ ^ R, alH < I, and all t > s > 0, 

El{t) 

{f,zi-{t)) = (/(• - siis,t)),z:{s)) + Yl fi<k - sm,,t)). 

k=El{s)+l 

Recall that / is always extended to be zero on (— oo,0) so that /(• — x) is 
well defined on M_|_ for all x > 0. Applying the fluid scaling (4.1) produces 

{f,Zl{t)) = {f{--Sl{s,t)lZl{s)) 

(5.2) 

+ - E f{viu-simkr-\t)). 

k=rEl{s)+l 

This equation yields several estimates that will be used frequently. If / is 
nonnegative and nondecr easing, then using the bound sup^gjg^ /(• — x) < 
/(•) in (5.2) yields 

{f,z:{t)) < (/(. - S:{s,t)),z:{s)) + {f,C:{s,t)) 

(5.3) 

<{f,z:{s)) + {f,ms,t)). 

If / is bounded, then (5.2) implies that 

(/,z[(t)) < (/(. -5r(.,t)),z[(.)) + \\f\ui,ms,t)) 

(5.4) 

<ll/IU(i,^r(.)) + ||/||oo(i,/:[(^,t)). 

By ignoring the sum in (5.2), we obtain for any nonnegative / that 

(5.5) {f{--S:{s,t)),Z:{s))<{f,Zl-{t)). 

An alternative dynamic equation to (5.2), that is satisfied by Zl{-) on 
certain time intervals, will be used when passing to the limit as r — oo. 
This equation is a prelimit analogue of the (3.1) satisfied by fluid model 
solutions. It is derived from (5.2) and is written in terms of projections 
against functions / in the more restrictive class 

(5.6) Cc = {/ € C : / has compact support in M+}. 

Note that for / G Cc, the derivative /' has compact support and ||/'||oo < oo. 
The proof of the following result appears in the Appendix. 
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Lemma 5.2. Fix r ^TZ. Almost surely, for all i < I, all f ^ Cc, and all 
finite time intervals [s,t\ C [0,oo) satisfying inf„g[^ j] Zl[u) > 0, we have 

{f,Zl{t)) = {f,Zl\s)) - [\f',z:{n))^^^BS^du 

Js ZHu) 

(5.7) 

+ {f,cm-{f,ms)). 

5.3. Compact containment. In this section, we establish the first of the 
two main conditions used in proving tightness. 

Lemma 5.3. Let T > and rj > 0. There exists a compact set K C 
such that 

hminf P^(^'^(t) G K for all t G [0,r]) > 1 - ??. 

Proof. By (4.15) and since |[ (1,2*^)11 < cxo almost surely, there exists 
an M > such that 

(5.8) P(|Kl,20)||V||(x,2°)||>M)<r?. 

Since (1,0 ^ continuous M^-valued function on M^, assumption 
(4.14) and the continuous mapping theorem imply that 

(5.9) i{l,Z^-m,{x,Z'\0))^i{l,Z^),{x,Z^)) asr^oo. 

The set {{z,w) eM.\xR\: \\z\\ V \\w\\ < M} is open, so by (5.8), (5.9) and 
the Portmanteau theorem, 

liminfP'-(||(l,Z^(0))||V||(x,2'-(0))||<M) 

(5.10) 

>P(|Kl,ZO)||V||(x,^°)||<Af)>l-r?. 

For each r £TZ, let be the event in the left-hand side of (5.10) and define 

ni = {\\{l,C\T))\\y\\{x,C{T))\\<K}, 

where K = {\\uT\\ V ||pr||) + 1. By Theorem 5.1, 

{{l,C{T)),{x,C{T))^{uT,pT) asr^oo. 

So liminfr^oo (^2) = 1 by the choice of K. For each r G 7^, let ilg be a 
full probability event on which the dynamic equation (5.2) holds. Then 

(5.11) liininfP'^(0^ no^no^) > 1-7?. 

Let K be the closure in of the set G : || (1, ^ || V || {x, 0\\<M + K}. 
The set K is compact by [11], Theorem 15.7.5. Fix r €TZ and an outcome 
(jj G n ^3 ; assume for the rest of the proof that all random objects are 
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evaluated at this to. Fix t € [0,T]; by (5.11), it suffices to show that Z^{t) € 
K. The dynamic equation bound (5.4) and the definition of QJi n H ^3 
imply that 

max(l, J[(i)) < max{(l,Zr(0)) + (1, £[(*))} 
i<i %<i 

(5.12) <max{(l,Zr(0)) + (l,£l'(r))} 

< M + K. 

Similarly, the dynamic equation bound (5.3) implies that 

max(x,^r(t)) <max{(x,^r(0)) + {x,Cim 

(5.13) < max{(x,^[(0)) + (x,^r(T))} 

<M + K. 

Combining (5.12) and (5.13) with (5.11) completes the proof. □ 

5.4. Asymptotic regularity near zero. Over any finite time interval, with 
arbitrarily high probabiUty as r — > 00, the fluid scaled state descriptor 2l{-) 
for route i puts arbitrarily small mass on a sufficiently small neighborhood 
of zero. This is proved in the following lemma, and is a key ingredient for 
establishing an oscillation property in the next section. 

Lemma 5.4. Let T > 0. For each £,r] ^ (0, 1), there exists an a> such 
that 

(5.14) hminfP^^f sup |Kl[o,a],2^(i))ll < > 1 " 

Proof. Fix e,r/ G (0,1). The proof consists of several steps. The first 
three steps are concerned with defining four high probability events 0^, r22, ^^3, ^^4. 
Steps four and five supply the desired bound (in two parts) on the intersec- 
tion of these events. 

Step 1. By (4.16), there exists 6 > such that 

(5.15) p('sup||(l[(„„i),,„,,],ZO)|| < £) > 1 - ^. 

\n&\ 4/ I 

Let B = G M^:sup„gN II (l[(n-i)b,nb] ' II < ^/4} and suppose that ^ G B 
and {i^} C satisfy ^ Choose L G N large enough so that || {l[Lb,oo),0 II < 

e/4. Since -—>■ for each i <I, the Portmanteau theorem implies that 

hm sup sup 1 1 ( 1 1) fe^nfc] , ) 1 1 
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<max||(l[(„„i)fe^„fe],OI| V iKl[L6,oo),OII < 4" 

So ^'^ S B for sufficiently large k, which implies that B C is open. We 
deduce from (4.14) and the Portmanteau theorem that 



(5.16) 




Combining (5.16) with (5.15) yields 

(5.17) hminfP^f sup |Kl[,,,+,], Z'"(0)) || < £) > 1 - ^. 

Let be the event in the left-hand side of (5.17). 

Step 2. By Lemma 5.3, there exists a compact set K C such that 

(5.18) liminf P'^(Z'"(t) G K for ah t G [0, T]) > 1 - |. 

Since K is compact, there exists M < oo such that 

(5.19) sup 11(1,011 <M. 

Let be the event in the left-hand side of (5.18). 

Step 3. By Lemma 2.2, there exists c > such that for each z < I, 

(5.20) Ai{z)>c on {z£R\:zi>e/8,\\z\\<M}. 

Let 6 = e(12||zy||)"^ AT and let a = 6c{2M)-'^ Ab. Choose iV G N large enough 
so that 

(5.21) Na> a + T\\C\\^. 

Let Iq = and, for each n G N, define /„ = [(n — l)a,na) and choose gn G 
Cfe(M+) satisfying l/„ < 5n < l/„_iU/„u/„+i ■ Then since ?9 is a vector of prob- 
ability measures, 

oo oo 

(5.22) max ^ {gn,'&i) < max ^ (l/„_iu/„u/„+i , < 3. 

~ n=l ~ n=l 
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For notational convenience, let gQ = l. For each n € N U {0}, the ]R^j_-valued 
map ^ I— > {gn,0 is continuous on M^. So for each such n, Theorem 5.1 and 
the continuous mapping theorem yield 

(5.23) {gn,C'{-))^i^i-){gn,^) asr^cx). 

The limit in (5.23) is a deterministic and continuous function taking values in 
M^. So, the convergence is uniform on compact time intervals in probability, 
and occurs jointly for all n = 0, . . . , N . Therefore, 

(5.24) hminfP^I max sup ||(5„,£^^(t)) - < -i-) = 1. 

Let be the event in (5.24) and let be a full probability event on which 
(5.2) holds. Define Q'q = n n''^ n ft^ n O^. By (5.17), (5.18) and (5.24), 

liminfP'Y^^f)) > 1 - r?. 

r^oo 

Thus, setting equal to the event in (5.14), it suffices to show that C 
for each r gTZ. To this end, fix r € 7^, w G t G [0,T], and i <1; assume 
for the rest of the proof that all random objects are evaluated at this uj. It 
suffices to show that 

(5.25) (l[o,a],^[ (*))<£• 
Step 4. Define the random time 

(5.26) T = sup|s<i:Z[(s)<||, 

where sup0 = 0. We first show that 

(5.27) sup(l[o,,](--x),J[(r))<^. 

If r = 0, this follows from the definition of since a < 6. If r > 0, then the 
definition of r implies the existence of f € [(r — (J)"*", r] such that (1, Zl{f)) = 
Zi{T) < e/8. By the dynamic equation bound (5.4) and the definition of f, 

sup (l[o,,](- -x), ^[(r)) < (l,Z[(f)) + (l,£[(f,r)) 

<| + (l,£l(r))-(l,£[(f)). 
Applying the definition of and noting that gQ = l, we obtain 

sup (l[o,a](- - a;),^[(r)) < ^ + - + 4? < ^ + '^1^11 + 7, 

xm+ o 4iV 8 4 

which implies (5.27) by the choice of 5. 
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Step 5. Note that if t = t, then (5.25) foUows directly from (5.27); so 
assume that t > t. For all s G (r,*], Z[(s) > e/8 and \\Z''{s)\\ < M by (5.19) 
and the definition of So, (5.20) implies that 

(5.28) inf Ai{Z''{s))>c. 

S€{T,t] 

Using (5.2) and (5.27), 

(l[o,a],^r(t)) = (l[o,a](--5r(r,t)),2[(r)) 

(5.29) +- ^ l[o,a]«k-S:mkr-\t)) 

k=rEl{T)+l 
oo rElit) 

< I + E 7 E l/J</c)l[o,a]«fc - ~Sl{Ul^r-\t)). 

n=l fc=r£;r(-^)^;^ 

Consider a flow k such that U'[f^r~^ € (r, t] and fj^i, G /„ for n > N. Then 
<fc ^^">« + ^ll<^l|8e"^- Since Z[(s) >e/8 for sG (r,t], 

Jm,r-^ Zlis) e 

Thus, - 5[(C/4r-i,t)) > a and so l[o,a]«, - Sl{Ul^T-\t)) = 0. We de- 
duce from (5.29) that 

N , rElit) 

(5.30) (lp^,],Z[(t))<- + ^- 5: ljMk)\^,aMk-~Sl{Ul,T~\t)). 

n=l fc=r£;[{T)+l 

Consider two flows k < I satisfying U[f^r~^ ,U[ir~^ G (r, t] and vl^^vli G In 
for some n = 1, . . . , A^. If U^ir~^ — U^j^r~^ > 5, then by the definition of 
(5.19), (5.28) and the definition of a, 

6c 

> TT > 2a. 

- M - 

Consequently, 

- Simr-\t)) - - S:{U:,r-\t)) >2a + vl,-vl,>2a-a = a 
and so at most one of 

l[,,a]{vlk-Smkr-\t)) and \,^,-^{vli - Sl{UliT-\t)) 
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is nonzero. This implies that flows arriving to route i during (r, t] with 
document sizes in I„ and residual document sizes at time t in [0, a] must 
all arrive during some time interval of length less than 6. That is, for each 
71 = 1, ... , iV, there exists an interval (^s^^ Sn + 5n] C (r, t] , with 6n < such 
that Ul,r-' G (r,t], G /„, and v^,- Sl{Ul,r-\t) G [0,a], implies U^.r-' G 
{sn,Sn + ^n]- Combining this fact with (5.30) yields 

Bound by g„ and rewrite the above to obtain 

N 

(l[0,a],^[(0)<^ + E sup ((5n,^r(^ + '^))-(5n,4(s))). 



Applying the definition of and (5.22), we obtain 

N ^ \ o 

(l[0,,],Zr(t)) < I + E i'^^H9n,^^) + ^) < { + 
n=l 

By the choice of 6, the right-hand side is bounded above by e. □ 



5.5. Oscillations. This section contains an oscillation bound used in prov- 
ing tightness. 

Definition 5.5. Let T > and G [0,r]. For each ((•) G D([0,oo),M^), 
define a modulus of continuity on [0,T] by 

(5.31) wt(C(-),<5)= sup di[C(s),C(t)]. 

s,te[o,T] 

\t~s\<5 

Lemma 5.6. Let T > 0. For all e,r] e (0, 1), there exists S > such that 

(5.32) liminf PVwt(^V-),(5) < e) > 1 - ?]. 

r — >oo 

Proof. Fix e,7] G (0,1). By Lemma 5.4, with e/2 in place of e, there 
exists a > such that 

(5.33) IrSfP'f sup ||(l[o,a],^^(t)>ll<^) >l-r?. 

VtG[0,T] 2/ 

Let be the event in (5.33) and let 5 = min{e(e A a)(4||C||)-\ e(4||_z/||)-^}. 
Since {^^0 is continuous on M^, Theorem 5.1 implies that {1,C^{-)) 
as r — > oo. Thus, 

(5.34) liminfP'Y sup || (1, ^'(t)) - < ^) = 1. 

VtG[0,T] 8/ 



r— >oo 
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Let t>e the event in (5.34) and let be a full probability event on which 
(5.2) holds. By (5.33) and (5.34), 

(5.35) liniinf P^(0^ n n fi^) > 1 - r?. 

Fix r gTZ and an outcome a; G Jlj^ fl H ; assume for the rest of the proof 
that all random objects are evaluated at this to. Fix i < I and s,t € [0,T] 
with s <t and t — s < 6. By (5.35), Definition 5.5 and (1.2) it suffices to 
show that 

d[Z[(.),zr(t)]<e. 
Let B C M+ be closed. By (1.1), it suffices to show the two inequalities, 

(5.36) {lB,Z'i{s))<{lB^,Z:{t))+e, 

(5.37) {lB,Z:{t))<{lB^,Zl-{s))+e. 
To show (5.36), use the definition of 0,i to write 

{lB,Z'i{s)) < {l[o,a],Zl{s)) + {lBnia,oo),Z:is)) 

(5.38) 

<2 + i'^Bnia,oo),Z-{s)). 

Let I = {ue[s,t]: Zl{u) < e/2}. Suppose that 1 = 0. Then Z[(ti) > e/2 for 
all n € [s,t\. So, by (2.1) and the definition of 5, 

T,r, ^ /■* Ai(Z'^(ii)) , 2||C|| eAa 
5.39 Sl{s,t)= -^L^^du<6^<^<eAa. 

Js Zl[u) e 2 

Consequently, x G i? n (a, cxo) implies x — Sl{s, t) £ B^, and so 

Br\{a,oo)cB^ + Sl{s,t). 
We deduce from (5.38) that 

{lB,Zlis)) < I + {lB^+siis,t),2:{s)) = I + {1b4- - S:is,t)),Z:{s)). 
Apply the dynamic equation bound (5.5) to obtain 

(5.40) {lB,Zl{s))<i + {lB.,Zl{t)). 

Now, suppose 1^0 and let r = inf /. Then by right continuity of (•)> 

(5.41) Z[(r) < |. 



Since Zl{u) > e/2 for all u S [s,t) 

Zlin) 



(5.42) S:is,r)=l ^™ldn<.«<a. 
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By (5.38) and (5.42), 

(iB,^r(s))<| + (i(,,^),j[(s)) 

-2~^ (^[5[(s,T),oo)'^r('5)) 

= | + (l[o,oo)(--5r(.,r)),J[(.)). 
Apply the dynamic equation bound (5.5) to obtain 

(5.43) {lB,Z:{s))<'- + {l,Zl'{T))<e. 

So (5.36) follows because either (5.40) or (5.43) holds. 
To show (5.37), note that by definition of 

(5.44) {l,CKs,t)) = {l,Cm - (!,£[(.)) < u,{t _.) + £< + | < |. 
By the first inequality in (5.4) and (5.44), 

(1b, ^rw) < M - si{s,t)),zi{s)) + (i,£r(s,t)) 

(5.45) 

<{lB+-si{s,t).Zl{s)) + ^-. 
UI = 0, then (5.39) implies that B + 5[(s,t) C -B^ So, (5.45) yields 

{iB,zi{t))<{iB.,z:{s)) + '-. 

then by (5.4), (5.41) and (5.44), 
(lB,Zr(t)) < (l,2r(r)) + (l,£r(r,t)) < (l,^[(r)) + (l,£[(.,t)) <e. 
In both cases, (5.37) holds. □ 

5.6. Tightness. This section combines the work of Sections 5.1-5.5 to 
prove the tightness claim of Theorem 4.1. 

Theorem 5.7. The sequence {{Z'' , Z'' ,f\U\W'')} is C-tight. 

Proof. For each T > and 5 € [0, T], let w^(-,(5) be the modulus of 
continuity on D([0, oo), M^) used in Corollary 3.7.4 of [6]. By Definition 5.5, 

w^(C(-),<5)<WT+5(C(-),2<5) 

for all C(-) e D([0,oo),Mi). So by Lemmas 5.3 and 5.6, the measure valued 
state descriptors {Z'^} satisfy the compact containment and oscillation con- 
ditions of Corollary 3.7.4 in [6]. Thus, {Z'^} is tight. Moreover, Definition 
5.5 and Lemma 5.6 also imply that any weak limit point Z (obtained as 
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a limit in distribution along a subsequence of {2^}) is continuous almost 
surely. Since Z^{-) = {1,Z^{-)) and ^ i-^ (IjC) is continuous on M^, it follows 
that is C-tight. 

By (4.3) and (2.1), T'^{-) is almost surely Lipscliitz continuous with Lip- 
schitz constant ||C||. Since this holds uniformly in r, the sequence {T""} is 
tight and any weak limit point T is almost surely Lipschitz continuous with 
Lipschitz constant ||C|[. By (4.4), C-tightness of {T*"} implies C-tightness 
of{f7''}. 

As r ^oo, W^'iO) {x,Z^) by (4.14), and {x,C'''{-)) ^ p(-) by Theo- 
rem 5.1. So (4.6) and C-tightness of {T^} imply C-tightness of {VF''}. It 
follows that {(^^ ly^} is C-tight. □ 

5.7. Weak limits as fluid model solutions. Let {Z, Z,T,U,W) be a weak 
limit of the sequence {{Z"^ , Z"^ ,T^' ,U^' ^W"^)} , and let {q} C 7^ be a subse- 
quence such that 

{Z'',Zi,f'>,U'',W'i)^{Z,Z,T,U,W) as g^oo. 

Note that since W'^{0) = {x,Z'^{0)) for all q, assumption (4.14) implies 
that {Z{0),W{0)) ~ (Z°,(x,^°)) and so W{0) ~ (x,2(0)). By Theorem 
5.1, (>C(-)i (X) ^'^i')) =^ pi')) as g ^ oo. Using the Skorohod represen- 

tation theorem, we may assume without loss of generality for the rest of 
this subsection that {Z,Z,T,U,W) and {(^^ Z^, T*, C7«, H^^, £5, (x, ^^))} 
are defined on a common probability space {Q,J-,P) such that, almost 
surely, W{0) = {x,Z{0)), and as g' — > oo, 

(5.46) {Z^,Z'',f'>,U'',W'',CMx,C''{-)))^ {Z, Z, T, U, W, p{-)), 

uniformly on compact time intervals. Let be the event of probability 
one on which W{0) = {x,Z{0)) and (5.46) holds. For each q, let be an 
event of probability one [cf. (5.2) and Lemma 5.2] on which (5.2) holds, and 
on which for all i < I, all / G Cc, and all finite time intervals [s,t] C [0,oo) 
satisfying inf^g^^^j] Zf{u) > 0, 

{f,Zf{t)) = {f,ZUs))-j\f',Zf{u))^^^^^du 

(5.47) 

+ {f,cm)-{f,^u^))- 

Then ^2 = Pig ^2 ^is° probability one. Define = ^1 ^2- 

Lemma 5.8 and Theorem 5.9 below establish that almost surely, Z is 

a fluid model solution with auxiliary functions {Z, T, U, W) for the data 

(A, C, A, u, i9), where W{t) is finite for ah t > 0. 

First, recall that for a function x : [0, 00) — > R, a regular point for x is a 

value of t G (0, 00) at which x is differentiable. If x is absolutely continuous. 
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then almost every t S (0, oo) is a regular point for x, and 

x{t) =x(0) + / x{s)ds, t > 0, 
Jo 

where x is equal to the derivative of x whenever x is differentiable, and 
X is equal to zero otherwise. A uniformly Lipschitz continuous function 
X : [0, oo) — > M is absolutely continuous. 

Lemma 5.8. Almost surely, for all t>0, the limit (Z, Z,T, U, W) satis- 
fies: 

(i) \\{i^o},m)\\=o, 

(ii) Zit) = {l,Zit)), 

(iii) U{t) = Ct-AT{t), 

(iv) W{t) = W{0) + pt-T{t), 

(v) W{t) = {x,Z{t)), 

(vi) W is uniformly Lipschitz continuous with Lipschitz constant \\p\\ + 
\\C\\, 

(vii) for all i <I, 

Ti{t) = J\uZ{s))l^o,oc){Z^{s))+Pil{o}{Zi{s)))ds, 

(viii) Uj is nondecreasing for all j < J . 

Proof. Let T > 0. It suffices to show (i) for all t G [0,r). By Lemma 
5.4, there exists a sequence {an :re G N} of positive real numbers such that, 
for each fixed n, 

(5.48) limigfPf sup ||(lp,,„),J^(t))||<i) >l--i. 

1-*'^ \tG[0,T) njn^ 

For each n G N, let A„ = G : || (l[o,a„)i II ^ l/''^}> suppose that 
{i^} C A„ satisfies .^'^ ^ as k ^ oo. By the Portmanteau theorem, 

|Kl[0,a„),OII<limSUp||(l[o,a„),e')ll<^. 

So 1^ G A„, which implies that A„ C is closed for each n. By definition 
of the Skorohod topology, the set 

B„ = {C(-) G D([0, oo), M^) : C(t) G A„, for ah t G [0, T)} 

is closed in D([0, oo), M^) for each n. Thus, since Z'^ =^ Z, (5.48) and the 
Portmanteau theorem imply that 

(5.49) P(Z G B„) > liminf P(Z'? G B„) > 1 - ^. 
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We deduce from (5.49) and the Borel-Cantelli lemma that 

)/ oo oo \ 
>p U f]{ZeBn}]=i, 
\k=ln=k ) 

which proves (i). 

Fix an outcome w S fio and assume for the rest of the proof that all 
random objects are evaluated at this w. Property (ii) follows from (4.2) and 
(5.46). Property (iii) follows from (4.4) and (5.46), and property (iv) follows 
from (4.6) and (5.46). 

To prove (v), fix t > and i < I. Since W^^{t) = {x,Zf{t)) for all q, and 
since W^{t) Wi{t) as g ^ cx) by (5.46), it suffices to show that (x, 2f{t)) 
{x, Zi{t)) as q ^ oo. Since 2'-{t) Zi{t) as q ^ oo, it suffices to show that 
the g-indexed sequence of measures {Zf{t)} is uniformly integrable. To this 
end, note that if a sequence {^^} C M satisfies ^ and {x, C'') — > {x, < 

oo, then {^''} is uniformly integrable. Thus, {2^(0)} is uniformly integrable 
by the definition of f^i and (5.46), and {Cf{t)} is uniformly integrable by 
(5.46). We conclude from the dynamic equation bound (5.3) that, for each 
a; > 0, 

snp{xl[x,oo),2f(t)) <sup((xl[x,oo),^f(0)) + {xl[x,oo),mt)))- 
q q 

So uniform integrability of {Zf{t)} follows from uniform integrability of 
{Z!m and mit)}. 

To prove (vi), recall from the proof of Theorem 5.7 that T is uniformly 
Lipschitz continuous with Lipschitz constant ||C||. So, (vi) follows from (iv). 

To prove (vii), fix i < I. Since Wi and Tj are uniformly Lipschitz contin- 
uous, they are both absolutely continuous. Let t > be a regular point for 
both Wi and Ti. Then Wi{t) = - t^{t) by (iv). If Zi{t) = 0, then Wi{t) = 
by (v). Since Wi is a nonnegative function, this implies that Wi{t) = and 
so Ti{t) = Pi. Alternatively, suppose that Zi{t) > 0. By (ii), continuity of Zi 
implies continuity of Zi. So Zi{s) > for all s G + /i] and all sufficiently 
small h> 0. In this case, (5.46), (4.3), continuity of Aj on {z € : Zi > 0}, 
(2.1), and the bounded convergence theorem, imply that 

Ti{t + h)- Ti{t) = \^{f^{t + h)- f^{t)) 

rt+h 

(5.50) = lim / Ai(Z''(s))ds 

q^ooj^ 
t+h 

K{Z{s))ds. 

Since Aj(Z(-)) is continuous at t for Zi{t) > 0, it follows that 



(5.51) fi{t) = I 



Mz{t)), ifz,(t)>o. 

Pi, ifZ,(i) = 0. 
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Since almost every t > is a regular point for Wi and Tj, (5.51) implies (vii). 

Property (viii) follows because Uj is nondecreasing for each q and j <J, 
and because U'^ uniformly on compact time intervals by (5.46). □ 

The next result establishes the family of dynamic equations satisfied by 
the limit in (5.46). 

Theorem 5.9. Almost surely, for all i <1, f £ C, and t>0, 

{f,Z.{t)) = {f,zm) - f{f,Z.{s))^^^^^ds 

Jo Zi{s) 

(5.52) 

+ ^i{f,^i) l(o,oo)(-2'i(s))(is. 

Recall that the first integrand above is defined to be zero when Zi{s) = 0. 

Proof of Theorem 5.9. All random objects in this proof are eval- 
uated at a fixed outcome uj G such that (5.2), (5.46), (5.47) and the 
properties listed in Lemma 5.8 hold. The theorem will be proved first for 
/ G Cc, and an extension to C is made at the end. Recall that for f gCc, 
the derivative /' has compact support and ||/'||oo < oo. Note also that since 
/(O) = /'(O) = 0, there exists a constant Cf < oo such that |/(x)| < CfX for 
all X G M+. Therefore, 

(5.53) \{f,Z,m<Cf{x,Zi{t))=CfWi{t) foralH>0. 

The following preliminary result is used several times in this proof. 

For each fixed f gCc, each i < I and each interval [s,t] C M+ satisfying 

infne[s,t] Zi{u) > 0, we have 

(5.54) {f,Z,it)) = {f,Z,is))- [\f',Z,iu))^^^^^du + ,.,it-s){f,^,). 

Js Zi{u) 

To see this, fix an /, i and interval [s,t] satisfying the assumption. By (5.46) 
and Lemma 5.8 (ii), Z?(-) — Zj(-) as g — > cxo, uniformly on compact time 
intervals. Thus, 

(5.55) liminf inf Z^(ii) >0. 

By definition of 1^2, this implies that (5.47) holds for all sufficiently large q. 
Let g ^ oo in (5.47). Note that / and /' are elements of Cb(M+), and that Aj 
is continuous on {z G : > 0} (see Definition 2.1). Thus, (5.46) and (5.55) 
imply that for all q sufhciently large, the integrands in the second right- 
hand term of (5.47) are uniformly bounded on and converge pointwise 
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on [s,t] to {f, Zi{-)) ■ "'^PP^y bounded convergence to this term and 

apply (5.46) to the remaining terms in (5.47) to obtain (5.54). 

We now proceed with the proof of the theorem. Fix / € Cc, ? < I, and an 
interval [s,t] C M4. with t > s. Define 

(5.56) To = mi{ue[s,t]:Zi{u)=0}, 

where the infimum of the empty set is defined to be t. If tq > s, then 
iiiftie[s,r] > for all intervals [s,t] C [s,to). So, for each such r, (5.54) 
with T in place of t implies that 



(5.57) |(/,Z,(r)) - {f,Z,{s))\ < (r - s)||/'||oo||C|| + (r - s)u, 
Since both sides of (5.57) are continuous in r, letting t ] tq yields 

(5.58) \{f,Zi{To)) - {f,Zi{s))\ < (ro - s)||/'||oo||C|| + (tq - s)m 



Note that if tq = s, then (5.58) holds trivially. If tq < t, then Zi{TQ) = 
by continuity of Zj, and so (/, Zj(ro)) = Wi(ro) = 0. Then by (5.53) and 
property (vi) of Lemma 5.8, 

\{f,Z,{t)) - (/,^.(ro))| = \{f,Z,m < CfW,{t) 

(5.59) =Cf\Wi{t)-Wi{ro)\ 

<Cf{\\p\\ + \\C\\)it-To). 

If To = t, then (5.59) holds trivially. Combining (5.58) and (5.59) yields 

\{f,Z,{t)) - {f,Zi{s))\ < \{f,Z,it)) - (/,Z,(to))| 

+ \{f,Z,{To))-{f,Z,{s))\ 

<Cfi\\p\\ + \\C\\)it-To) 

+ (ll/'lloo||C|| + i/,||/||oo)(ro-s) 
<Kf{t-s), 

where 

i^/=c^/(iipii + ni) + ii/'iiooiicii+i.. 



Since s<t were arbitrary, it follows that {f,Zi{-)) is uniformly Lipschitz 
continuous and is therefore absolutely continuous on M+. Suppose t > is 
a regular point for both {f,Zi{-)) and Wj(-). If Zi{t) > 0, then by (5.54) 
(with [t,t + h] in place of [s,t]), and continuity of Aj on {z € : > 0} 
(see Definition 2.1), 

(/, z.it + .)> - (/. zm) , ^.(,))MM) , 

h^o n Zi [t) 
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If Zi{t) = 0, then {f,Zi{t)) = Wi{t) = 0, and so Wi{0) = because Wi is a 
nonnegative function. Combining this with (5.53), we obtain 



hm sup 



{f,Zi{t + h))-{f,Z,{t)) 



h 



lim sup 



{f,Z,{t + h)) 



(5.61) 



< hm sup C f 

h->0 



Hm sup C f 



h 

Wi{t + h) 



h 



W,{t + h)-Wi{t) 



h 



Cf\Wiit)\=0. 



Combining (5.60) and (5.61), we obtain 



(5.62) j^U.Zm 



0, 



z,(t)>o, 

Zi{t) = {). 



The set of ah t G (0, oo) that are regular points for both (/, Zi{-)) and Wi{-) 
has full Lebesgue measure, so (5.52) follows from (5.62). 

This proves the theorem for f £ Cc- To extend to C, choose functions 
{gn:n£N}c C^(M+) such that l[o,n] < On < l[o,n+i] and ||g^||oo < 2 for ah 
n. For f £ C, define fn = fgn so that /„ G Cc for all n. Then for all n G N 
and t>0, 



(5.63) 



{fn,Z,{t)) = {fn,Zm- f {fn,Zi{s))^ 

Jo Zi 



is) 



ds 



+ J^i{fn,'&i) / l(o,oo)(^i(s))(is. 



Since fn^ f pointwise and boundedly as n ^ oo, the bounded convergence 
theorem implies that the left-hand side, as well as the first and third terms 
on the right-hand side of (5.63), converge to the corresponding terms of 
(5.52) as n — > cx). Similarly, — > /' pointwise and boundedly as n ^ oo. So, 
the integrand in the second right-hand term of (5.63) converges pointwise 
on [0,t] to {f, Zi{-)) ^y.f_\''* as n ^ oo. For each n G 



sup 

se[o,t] 



Zi{s) 



<||/;i|oo||C||<(||/'||^ + 2 



Mc\\. 



So, the bounded convergence theorem implies that the second right-hand 
term in (5.63) converges to the corresponding term in (5.52) as n — > oo. □ 



Proof of Theorem 4.1. The sequence {(Z^Z^T^ [/^ W"'")} is C- 
tight by Theorem 5.7. Let (Z, Z,T,U,W) be a weak limit point of this 
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sequence. Then by Theorem 5.9 and properties (i)-(v), (vii) and (viii) of 
Lemma 5.8, ^ is almost surely a fluid model solution with auxiliary functions 
{Z,T,U,W) for the data {A,C, A,h',-&) (see Definitions 3.1 and 3.2), and 
Wit) is finite for ah t > 0. □ 

6. Invariant states for fluid model under weighted cc-fair policies. In 

this section, we consider the special case of weighted a-fair policies. Fix fluid 
model data {A,C,A,i','d), where A is a weighted a-fair bandwidth sharing 
policy with parameters (a,K) as described in the example of Section 2.2. 
Under a natural condition on the network parameters A, C, u and t?, there 
exist fluid model solutions that are time invariant. This section identifies the 
condition and characterizes the set of these invariant states. 

The following representation of the weighted a-fair policy A follows from 
Lemma A. 4 of [12]. (Although it is assumed at the beginning of [12] that A 
has full row rank, this property is not used in the proof of Lemma A. 4 in 
[12], and hence the result holds without restriction on the row rank of A.) 

Proposition 6.1. For each z eR\, there exists at least one p G M^, 
depending on z, such that 

(6.1) Ai{z)=zJ ^ for alii Gl+{z), 
where 

(6.2) pj (^Cj - ^ AjM^)^ = for all j < J. 

The (pj-j < J) are Lagrange multipliers for the optimization problem 

(2.3) -(2.5), one for each of the capacity constraints in (2.4). Note that for 
each i € I+{z), the bandwidth Aj(z) > by Definition 2.1(i), and Zj > by 
definition. Thus, (6.1) implies that the denominator on the right-hand side 
of (6.1) does not vanish. 

Definition 6.2. A vector of measures € is an invariant state for 
the fiuid model if there is a fiuid model solution satisfying ({t) = ^ for 
aU t > 0. 

The following notation helps describe invariant states. Recall that /.tj = 
(Xi'^i)""'^ and Pi = Vi/pi for i < I. Also recall that T^{z) = {i < I:zj > 0} 
and 1q{z) = {i<l:zi = Q} for z S M^. Let 



V={ze'&\:Ki{z)=pi for all i G J+(z)}. 
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For each i < I, let i?f denote the excess hfetime distribution associated with 
The probabihty measure is absolutely continuous with density 

Theorem 6.3. There exist invariant states for the fluid model if and 
only if 

(6.3) Ap < C. 

When (6.3) holds, the set of invariant states is given by 

(6.4) M = {^eM^:^i = Zi'&l for all i <I and some z G V}. 

Proof. Suppose that ^ is an invariant state and let = ^ be the 
corresponding fluid model solution with auxiliary functions {z,t,u) given 
by Definition 3.1 (we omit w here). Then z is a constant vector, denoted 
z = (1,0- ^'^^ each f £ C, i I+iz) and t > 0, property (iii) of Definition 
3.2 yields 

(6.5) {f,^i) = {f,^,)-t{f',^,)^ + t,y,{f,^,). 
Since (cf. Proposition 3.1 in [20]), 

(6.6) (/,^.) = l(/',^e^ for all /gC, 
canceling like terms in (6.5) yields 

(6.7) 

Zi 

Replacing / by a suitable sequence of functions {/n} C C satisfying > 
and f'^ 1 1(0, cxd) 5 the monotone convergence theorem implies that (6.7) holds 
with /' = l(o,oo). So by property (i) of Definition 3.2, and since t?| does not 
charge {0}, 

(6.8) ki{z) = Pi for all i G T+{z). 

Since Zi = for i G Tq{z), this implies by Definition 3.1 that for all t>0, 

(6.9) Ti{t) = J^{Ai{z)l(^Q,^){zi) + pil^Q}{zi))ds = Pit forani<I. 

Thus, u{t) = Ct — Apt = (C — Ap)t for all t>0. Since u is nondecreasing by 
property (ii) of Definition 3.2, (6.3) holds. Moreover, substituting (6.8) into 

(6.7) and canceling pi yields 

{f',C^ 



Zi 



{f\^t) for all / G C and i G I+{z). 
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This implies (in the same manner as in the proof of Theorem 1.1 in [20]) 
that 

(6.10) ii = Zi'&t for all i G l+{z). 

Since = for all i € 1{){z)^ combining (6.10) with (6.8) implies that ^ G A^. 

To prove the converse, suppose that (6.3) holds and let ^ G Al. Define 
Q{t) = ^ for all t > 0, and let (2, r, u) be the auxiliary functions of C, given by 
Definition 3.1. Since ??f does not charge {0} C ffi+ for each i < I, satisfies 
property (i) of Definition 3.2. Note that z = {!,£,) is a constant vector, and 
that z £V because ^ € Al. Thus, r satisfies (6.9) and so u(t) = Ct — Apt = 
(C — Ap)t for all t > 0. By (6.3), uj is nondecreasing for all j < J, and so 
property (ii) of Definition 3.2 holds. Let / G C and i G I+{z). Since ^ G 
and z G (6.6) implies that for all t>0, 

t{f',C^)^=tp^{f',^!)=tMf,^,). 

Zi 

Thus, (6.5) holds and so satisfies property (iii) of Definition 3.2 for i G 
Ij^{z). This property holds for i ^ I+iz) since then all terms are zero. Thus, 
C is a fluid model solution. Note that M. is nonempty because ^ = is in 
M. □ 

Under condition (6.3), the set V can be characterized using results in 
Kelly and Williams [12]. (Although it was assumed in [12] that A has full 
row rank, as we explain below, the results that we cite below from [12] hold 
without that additional restriction.) Let 



and let J* = |^*|. For z G M^, define 

When X^0, define A : R-J.* ^ R\ by 

A{w) = argmin< F{z) : z G and ^ ^ji— ^ Wj for all j G JT* >. 

I i<l ^» J 

For each j € J'^,, Aji > for some z < I. It follows that the feasible set for 
the above optimization problem is nonempty. Then since F is nonnegative, 
continuous, strictly convex and satisfies F{z) —f 00 as \\z\\ — s- 00, A^w) is well 
defined as the unique minimum of the optimization problem. 
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Lemma 6.4. Assume that (6.3) holds. If J* = 0, then V = {0} and the 
only invariant state is ^ = Q. If , then the following three conditions 
are equivalent: 

(i) zeV, 

(ii) for some g S M+ , = J2jej, (Ij^jiY^'^ for all i < I, 

(iii) z = A{vu{z)), where Wj{z) = J2i<i^jij^ for all j ^ J^. 

Proof. If = 0, then Ap < C. In this case, there is no z 7^ such 
that Ai{z) = Pi for all i G I^{z). This follows because for z 7^ 0, the optimal 
solution A(z) of the concave optimization problem (2.3)-(2.5) must have 
one of the constraints binding, that is, {AA{z))j = Cj for some j < J. (For 
this, we use the fact that there is at least one route i, which necessarily uses 
at least one resource j, and hence there is at least one i and j such that 
Aji > 0.) It follows that V = {0} when = 0. 

If J7* 7^ 0, then the three equivalent characterizations of V follow from 
Lemma 5.1 and Theorems 5.1 and 5.3 in [12]. (At the beginning of [12], 
it is assumed that A has full row rank. However, scrutiny of the proofs of 
Lemma 5.1 and Theorems 5.1 and 5.3 of that paper reveals that the above 
equivalence still holds without this additional assumption. Indeed, one only 
needs the weaker property that for each j G the jth row of A has at least 
one nonzero entry. This property holds here by the definition of J'^,.) □ 



Proof of Theorem 5.1. For each r eTZ, define a simplified fluid scaled 
load process 



the second component of (A. 2) follows from assumptions (4.12), (4.13) and 
a functional weak law of large numbers. Note that for each K > 0, the set 
{£, € • 11(1 V XjOII — ^} is relatively compact in (see [11], Theorem 



APPENDIX 



(A.l) KW = 7E%.' t>0,z<I 



and let i?(t) = t'd for alH > 0. We first show that 

(A.2) {V^{.),{x,V{-)))^m,{x,m) asr 

Since for each r € 7^, t > 0, and i < I, {x,'&i) = and 
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15.7.5). For each T > 0, supig[o,T] II (1 V x, V'^ W) II < ^ V |Kx, V^(r)) ||, and so 
the second component of (A. 2) imphes the compact contamment condition 

(A.3) hm hminfP''( sup || (1 V x, V''(i)) II < ^ ) = 1- 

K^oo r^oo VjG[0,T] / 

Moreover, for ah r gTZ, i <1, t>s>0, and all nonempty closed B C M+, 
(A.l) implies the two inequalities 

(iB,vr(s)) < vr(i)) < {iB^-sX{t))+t-s, 

1 LrtJ 

(iB,v[(t)) = (iB,vr(s)) + - E iB«fc)<(iB-,vr(s))+t-^. 

fc=[rsj+l 

So by (1.1) and (1.2), 

di[V''(s), V'^(t)] < t - s for aU r G 7^ and t > s > 0. 

On combining this with (A.3), we see that {V'"(-)} is C-tight. Let {V'^(-)} C 
{V^'(-)} be a weakly convergent subsequence with almost surely continuous 
limit V(-). Then by the continuous mapping theorem, for all / € Cb(]R+), 

(A.4) (/,V''(.))^(/,V(-)) asg^oo. 

On the other hand, for each / € Cf,(]R4.), t > 0, and i <1, 

iim)) = E(/(4) - u,^D) +^u,^t)- 

Assumptions (4.11)-(4.13), and a functional weak law of large numbers im- 
ply that (/,V^(-)) =^ {/,'&{■)) as oo for each / G C6(M+). Combining 
with (A.4), we see that V(-) = ??(•) almost surely, and so V' (-) ??(•) as 
r oo. Since the limits are deterministic, the convergence in (A. 2) is indeed 
joint. 

By assumption (4.10), => u{-) as r ^ oo. Since ^'^(•) = V''{E''{-)) 

and {x,'&{i^i-))) = p{-), (A. 2) and the random time change theorem imply 

(5.1) . □ 

Proof of Lemma 5.2. Let Ql be an event of probability one on which 

(5.2) holds and fix u; G fi^^. For the rest of the proof, all random objects are 
evaluated at this particular u. Fix i < I, / G Cc, and let [s,t] be an interval 
satisfying inf„g[5 j] Zj^(u) > 0. It suffices to show (5.7). Since Zl{-) is right 
continuous with finite left limits, there exist e,M G (0,oo) such that 

(A.5) e< inf Z[(n) < sup Z[(u)<M. 

uG[s,t] 

Let I = t — s and, for n, j G N, let tj = s + jl/n and = ij+i. For each n, 

j=0 
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Add and subtract a term in each summand to get 

n-l 

{f,z:it)) - uaiis)) = j2i{f,z:{t^)) - (/(. - s:itj,tn),zi{t,))) 

j=0 
n-l 

j=0 

Use the dynamic equation (5.2) in the first term and rewrite the second term 
on the right to obtain 

n-l ^ rE-iP) 



{f,zm - {f,zi{s)) = J2- J2 f«k - ~s:{ui,r~\t^)) 



(A.6) 



i=0 fe=rK-{tj)+l 
n-l 



+ E(/(--^r(*i'*'))-/(-),^r(t.))- 

j=0 



Denote the first and second right-hand terms in (A.6) by aj^ and U^, respec- 
tively, and consider first a^. Since f eCc, a first-order Taylor expansion of 
each summand yields 



(A.7) 



where for each j and k, hj = —SKU^j^r ^,t^) and S R is in the interval 
[^Ifc + Since Ulfj-~^ € (^j)*"'] for each pair j, in (A.7), (2.1) and 

(A. 5) imply that 



(A. 



max \ hA < max 

j,k j 



UZ^ju) ) ^ l\\C 
Zl{u) 



du < 



ne 



Using (A.7) and (A. 8), deduce that for each n, 



Wn-{{fAit))-{fAXs)))\ 



n-l 



k=rEl(s)+l 
rEliP) 



E 7 E 



So as n — > oo, 
(A.9) 



j=0 k=rEl{tj)+l 

<{E:{t)-E:{smf'\ 

a;-((/,£I(t)) -(/,£[(.))). 



^IICI 



ne 
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Next, consider ftj^. Another first-order Taylor expansion for each x € 
and j € {0, . . . , n — 1} yields 



(A.IO) 



f{x-S^{t^,P))-fix) = f'{w])hj, 



where hj = —Sl{tj,P) and G M is in the interval [x + hj,x\. Define 



(A.ll) 



HZ'{u)) 

Zj = sup — - — 



and let hj = —zjl/n. Combine terms and bound the integrand to obtain 

3=0 
n-1 

Y^ifi- - sutj,t^)) - /(•) - /'(>„zr(t,)) 

j=0 
n-1 

< J2 sup|/(x - - fix) - fix)h,\{l,Z:itj)). 



j=0 



Apply (A.5) and (A.IO) to get 

j=0 



n-1 



(A.12) 



<J2snp\f'iw])h, - f'{x)h,\{l,Z:{t,)) 



n-1 



< M ^ sup(|/'(^J) - fXx)\\hj\ + \nx)\\h, - h,\). 

Since Wj g[x + hj,x] for each j G {0, . . . , n — 1} and x G M, deduce from the 
definition of hj, Sl{tj,t^), and from (2.1) and (A.5), that 



(A.13) 



Iwj - x\< \hj\ 



" A.(g(i.)) , ,/||C|| 



Since /' has compact support, it is uniformly continuous. Hence, there exists 
a continuous nondecreasing function ipj :M+ — > such that ^/(O) = and 
for ah /iGR, , 



(A.14) 



snp\f'{x + h)-nx)\<^Pf{\h\). 
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We deduce from (A.12)-(A.14) that 



(A.15) 



n-1 



j=0 



/||C||\/||C7 



n-1 



ne J ne 



+ ll/'l|ooE 
i=0 



n 



Let (pniu) = Z]j=o each n G N and u S [tj,t^. Then 



n-1 



n 



(pniu)du 



Zl{u) 



du. 



(A.16) 

Observe that 4>n{u) — > Ki{Z'^ {u))Zl{u)~^ as n ^ oo, for all u E at which 
the latter function is continuous, which is at almost every u. So, by the 
bounded convergence theorem, (A.16) converges to zero as n — s- oo. This 
implies, by definition of ^j, that (A.15) converges to zero as n ^ oo. Note 
that 

n— 1 n— 1 1 

j=0 j=0 " 

and that, as n — > oo, 

n-1 



""^ _ I - 



Zl{u) 



du. 



by (A. 11) and bounded convergence, since the integrand on the right is also 
continuous at almost every u. Conclude that, as n ^ oo. 



(A.17) 



(r,jr(n))M£;M)dn. 



Combining (A. 6), (A.9) and (A.17) yields (5.7). □ 
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